Papers with LLaMA-3-8B model
Explore the Reasoning Capability of LLMs in the Chess Testbed (2025.naacl-short)
Copied to clipboard
| Challenge: | a recent study shows that large language models struggle with long-term, complex reasoning tasks. |
| Approach: | They propose to integrate annotated strategy and tactic into large language models to improve reasoning capability. |
| Outcome: | The proposed model performs better than GPT, Claude, and Gemini models . it integrates annotated strategy and tactic into the model . |
Large Language Models with Reinforcement Learning from Human Feedback Approach for Enhancing Explainable Sexism Detection (2025.coling-main)
Copied to clipboard
| Challenge: | Recent advances in natural language processing have significantly improved text comprehension. |
| Approach: | They propose a Reinforcement Learning from Human Feedback (RLHF) based fine-tuning framework for sexism detection that leverages contextual learning to understand and apply instructions to new scenarios without additional training. |
| Outcome: | The proposed framework outperforms existing models on three EDOS tasks and scores 0.8681 on binary sexism detection, 0.6829 on category classification of sexists and 0.4722 on task C. |
Theory-optimal Quantization Based on Flatness (2026.acl-long)
Copied to clipboard
| Challenge: | Recent approaches to quantization of Large Language Models (LLMs) have been widely adopted due to activation outliers, which degrade model performance especially at lower bit precision. |
| Approach: | They propose a new metric for quantization that strategically distributes outlier magnitudes across matrix dimensions via optimized diagonal operations. |
| Outcome: | The proposed framework achieves less than 1% accuracy drop in W4A4 quantization on the LLaMA-3-8B model and reduces the performance gap by 39.1% on the more challenging W2A4KV16 model. |